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1 Introduction 

Let (^l,J-,P) be a probability space and (Wt)t>o be a Brownian motion on this space. 
Let F be a random variable defined on f2 which is differentiable in the sense of Malliavin 
calculus. Then, using Stein's method on Wiener chaos, introduced by Nourdin and Peccati 
in [10] (see also [TT| and [H]), it is possible to measure the distance between the law of F 
and the standard normal law -/V(0, 1). This distance can be defined in several ways (the 
Kolmogorov distance, the Wasserstein distance, the total variation distance or the Fortet- 
Mourier distance). More precisely we have, if C(F) denotes the law of F, 



d(C(F),N(0, 1)) <csjE{l- (DF, D(-L)-^F) LHm) ) 2 . (1) 

Here, D denotes the Malliavin derivative with respect to W while L is the generator of the 
Ornstein-Uhlenbeck semigroup. We will explain in the next section how these operators are 
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defined. The constant c is equal to 1 in the case of the Kolmogorov and of the Wasserstein 
distance, c=2 for the total variation distance and c = 4 in the case of the Fortet-Mourier 
distance. 

These results have already been used to prove error bounds in various central limit the- 
orems. In |10| the authors prove Berry-Esseen bounds in the central limit theorem for the 
subordinated functionals of the fractional Brownian motion and [11] focuses on central limit 
theorems for Toeplitz quadratic functionals of continuous-time stationary processes. In [13] 
the authors extended the Stein's method to multidimensional settings. See also [T]. 

In this paper we will consider long memory moving averages defined by 

X n = aiS n -i,n £ Z 

i>l 

where the innovations e$ are centered i.i.d. random variables having at least finite second 
moments and the moving averages a% are of the form a% = i~@L(i) with /? G an d 
L slowly varying towards infinity. The covariance function p{m) = E (XoX m ) behaves as 
cpm~ 2 P +1 when m — > oo and consequently is not summable since j3 < 1. Therefore X n 
is usually called long-memory or "long-range dependence" moving average. Let K be a 
deterministic function which has Hermite rank q and satisfies E(i^ 2 (X n )) < oo and define 

N 

S N = Y,[K(X n )-E(K(X n ))}. 
n=l 

Then it has been proven in [8] (see also [T7]) that, with ci((3,q),C2(/3,q) being positive 
constants depending only on q and /3: a) If q > 2 p-\ > then the sequence c±(f3, q)-^=SN con- 
verges in law to a standard normal random variable and b) If q < > then the sequence 

C 2(P, q)N^ q ~i~ l Sn converges in law to a Hermite random variable of order q. This Hermite 
random variable, which will be defined in the next section, is actually an iterated integral of 
a deterministic function with q variables with respect to a Wiener process. This theorem is 
a variant of the non-central limit theorem from [7] and [15 J . In order to apply the techniques 
based on the Malliavin calculus and multiple Wiener-Ito integrals, we will restrict our focus 
to the following situation: the innovations e$ are chosen to be the increments of a Brownian 
motion W on the real line while the function K is a Hermite polynomial of order q. In this 
case the random variable X n is a Wiener integral with respect to W, and H q (X n ) can be 
expressed as a multiple Wiener-Ito stochastic integral of order q with respect to W. When 
q > 2/3-1 we w ^ n a PPly formula ([T]) in order to obtain the rate of convergence of Sn- When 
q < 2B—i the limit of Sn (after normalization) is not Gaussian and so we will use a different 
argument based on a result in [6J that has already been exploited in [2]. 

The paper is organized as follows. Section 2 deals with notation and preliminaries, such as 
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the definition of a moving average process and a Wiener process on R, but also gives a brief 
introduction to the tools of Malliavin calculus. In section 3, we will prove the Berry-Esseen 
bounds for the central and non central limit theorems for long-memory moving averages. 
Section 4 shows an application of our results to the Hsu-Robbins and Spitzer theorems for 
moving averages. 

2 Notation and Preliminaries 

In this section, we will give the main properties of infinite moving average processes and 
a proper definition of a Brownian motion on R. We will relate one to the other to prove 
that the processes that we will consider in the latter are well defined. To conclude the 
preliminaries, we will finally focus on the sequences and results, such as central and non- 
central limit theorems that interest us in this paper. 

2.1 The Infinite Moving Average Process 

Before introducing the infinite moving average process, we will need the proper definition 
of a white noise on Z. 

Definition 1 The process {Zt} t& % is said to be a white noise with zero mean and variance 
a 2 , written 

{z t } ~ nW(o,<7 2 ), 

if and only if for every h E N, {Zt} has zero mean and covariance function j(h) = 
E (Z t+h Z t ) defined by 

a 2 if h = 
if h^O. 



1(h) 



Now we can define the infinite moving average process. 
Definition 2 If {Zt} ~ WN(0, a 2 ) then we say that {Xt} is a moving average (MA(oo)) 

-VOC 

^7= 



of {Z t } if there exists a sequence {tpj} with IV^'I < 00 suc ^ that 



X t = Y,^3 Z t-v * = 0,±1,±2,... (2) 

3=0 

We have the following proposition on infinite moving averages (see [3] p. 91). 

Proposition 1 The (MA(oo)) process defined by |||) is stationary with mean zero and 
covariance function 

oo 

-l{k) = a 2 ^ipjip j+ \ k \. (3) 

3=0 

For further details on moving averages, see [3] for a complete survey of this topic. 
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2.2 The Brownian Motion on R 

Here, we will give a proper definition of a two-sided Brownian motion on R (as defined in 
[4]). We will then connect this definition to the underlying Hilbert space. 

Definition 3 A two sided Brownian motion {Wt} tgJR onl is a continous centered Gaussian 
process with covariance function 

R(-t,s) = ^(\s\ + \t\-\t-s\), s,tER. (4) 

Let H = I? (R) be the underlying Hilbert space of this particular process. We have 

( 1 [o,s] ) l[o,i]) ?{ =s At if s,t>0 
r > (/ _ . (l[»,0]il[o,t]>« =0i/s<0and f>0 

S (l[O, s] .l[ S ,0]) ?i = 0i/ *>0and t<0 { °> 
(l[8,o],l[t,o]) w = -(sVi) = |s|A|i| t/ s,i<0. 

PFe couW a/so define the two-sided Brownian motion by considering two independent stan- 
dard Brownian motions on R + ; <^wj ^| and and by setting 

... / W t {1) if t > 

m = \ wl 2 >*/t<o. (6) 

{Wt} has the same law as the one induced by the first definition. 

If we define the process {It}t & z as the increment of the two-sided Brownian motion between 
t and t + 1, t G Z, we have = Wt+i — Wt- The following holds. 

Proposition 2 T/ie process {It\t& ^ s a white noise on Z with mean and variance 1. 

Proof: It is clear that {It} is a centered Gaussian process. We only need to verify its 
covariance function. We have, for every h € Z, 



E (I t+h I t ) = E ((WWi - W t+h )(W t+1 - W t )) 



1 if h = 
Oif h^O 



2.3 Limit Theorems for Functionals of i.i.d Gaussian Processes 

Here, we will focus on the following type of sequences 

N 



S N = Y J [K(X n ) - E (K(X n ))} (7) 



71=1 
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where 

oo 

x n = on (W n .i - Ty n _ 4 _i) , (8) 



1=1 

^00 2 



with Qj G R and «f = 1- Note that {X n } is an infinite moving average of the white 

noise {It} = {Wt+i — Wt}. Thus its covariance function is given by 

oo 

p(m) :=^2aia i+ \ m \. (9) 

i=l 

For those sequences, central and non-central limit theorems have been proven. Here are the 
main results we will be focusing on. 

Theorem 1 Suppose that the on are regularly varying with exponent —(3, (3 G (1/2,1) (i.e. 
ati = \i\~^ L(i) and that L(i) is slowly varying at oo). Suppose that K has Hermite rank k 
and satisfies E(K 2 (X n )) < oo. Then 

i. Ifk< (2/3 - I)" 1 , then 

h7\N^-i- l S N — »• (10) 

where Z^ is a Hermite random variable of order k defined by |j^[ ) and h\~^ is a 
positive constant depending on k and (3 (which will be defined later by $33\)). 

ii. Ifk> (2(3 - I)" 1 , then 

-J— — > AT(0,1) (11) 

with Ok,p defined by [24\ ). 

We will compute the Berry-Esseen bounds for these central limit (CLT) and non-central 
limit (NCLT) theorems using Stein's Method and Malliavin Calculus. In the next paragraph, 
we will give the basic elements on these topics. 

2.4 Multiple Wiener-Ito Integrals and Malliavin Derivatives 

Here we describe the elements from stochastic analysis that we will need in the paper. Con- 
sider H a real separable Hilbert space and (B(ip), ip G T~L) an isonormal Gaussian process on 
a probability space (Q, A, P), which is a centered Gaussian family of random variables such 
that E (B (tp) B (ijj)) = (<p,ip}%. Denote by I n the multiple stochastic integral with respect 
to B (see [H]). This I n is actually an isometry between the Hilbert space H &n (symmetric 
tensor product) equipped with the scaled norm -^\\ • an d the Wiener chaos of or- 

der n which is defined as the closed linear span of the random variables H n (B(ip)) where 
(p G H, || V lift = 1 an d H n is the Hermite polynomial of degree n > 1 

H n ( X ) = LJ. exp _ _ exp (- , xGR. 



5 



The isometry of multiple integrals can be written as: for m, n positive integers, 

E (I n (f)Im(g)) = n\{f,g) n ®n if m = n, 

E(J n (/)J m ( ff )) = if m^n. (12) 

It also holds that 

Inif)=In{f) 

where / denotes the symmetrization of / defined by f(x\, . . . , x n ) = -j X^o-eSn /( x o-(i)> • • • > x a(n))- 

We recall that any square integrable random variable which is measurable with respect 
to the o"-algebra generated by B can be expanded into an orthogonal sum of multiple 
stochastic integrals 

F = Y J Wn) (13) 

n>0 

where f n S H &n are (uniquely determined) symmetric functions and Io(fo) = E [F]. 
Let L be the Ornstein-Uhlenbeck operator 

LF = -J^nlnifn) 

n>0 

if F is given by (fT3l) , 

For p > 1 and a G M we introduce the Sobolev-Watanabe space D a ' p as the closure of 
the set of polynomial random variables with respect to the norm 

\\F\\ a<p = \\((I-L)F^\\ LP{n) 

where / represents the identity. We denote by D the Malliavin derivative operator that acts 
on smooth functions of the form F = g(B(ipi), . . . ,B(ip n )) (g is a smooth function with 
compact support and ifi G U) 

n Pt 

DF = Y,Q^(B(<pi),...,B(<p n ))w. 

i=l 

The operator D is continuous from B Q,P into D a_1 ' p (%) . 

In this paper we will use the Malliavin calculus with respect to the Brownian motion on 
M as introduced above. Note that the Brownian motion on the real line is an isonormal 
process and its underlying Hilbert space is H = L 2 (R). 
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We will now introduce the Hermite random variable, which is the limit in Theorem 1, 
point i. The Hermite random variable of order q is given by 

Z^=d(q,P)I q (gC)) (14) 

where ^ 

g(m,»,yq)= du(u-y 1 )~ (5 ...(u-y q )~' 3 . (15) 

The constant d(q, (3) is a normalizing constant which ensures that E(Z^) 2 = 1. This 
constant is explicitly computed below. 

E(Zfe>) 2 = qld(q,P) 2 J dudvU (u-y)+ P (v-y)+%Y 

= /3) 2 /3(2/3 - 1,1-/3)" C dudv\u - v\- 2qb+q 



o 



l\d(q, /3) 2 /3(2/3 -1,1- ft* 



-2pq + q+l){-2pq + q + 2) 
where we used 

(u - y)- + \v - ytfdy = (3(2(3 -1,1- 0)\u - v\~^ +1 = c p \u - v\~ 2 ^ 
and we denoted cp := (3(2(3 — 1, 1 — (3) 7 (3 being the beta function defined by 



pi poo 

(3(x,y)= / F- 1 (l-t)v- 1 dt= / - 

J J V 1 



OO MX— 1 



+ t) x+ y 



-dt. 



Therefore 

iM?= twi±i±m^i±i±A. {16) 

2q\c q p 



2.5 Stein's Method on a Fixed Wiener Chaos 

Let F = I q (h), h 6 be an element on the Wiener chaos of order q. Recall that for any 
fixed z£K, the Stein equation is given by 

l {oo , z] (x)-<S>(x) = f(x)-xf(x). (17) 

It is well known that (fTTj) admits a solution f z bounded by \/27r/4 and such that H/^H^ < 1. 
By taking x = F in (jT71) and by taking the expectation, we get 

P(F < z) - P(iV < z) = E (f' z (F) - Ff z (F)) (18) 
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where N is a standard normal random variable (N M(0, 1)). By writing F = LL 1 F 
—5DL~ 1 F and by integrating by part, we find 

E(Ff z (F)) = E(-5DL- 1 Ff z (F))=E((-DL- 1 F,D(f z (F))) n ) 

= E {(-DL^F, f' z (F)DF) H ) = E (f' z {F) (-DL^F, DF) % ) . 



Thus, by replacing in {Taj) , we obtain 

E (f' z {F) - Ff z (F)) = E (f' z (F) (1 - (-DL~ X F, DF) H )) 

and 

P(F < z) - P(N < z) = E (f' z (F) (1 - (—DL~ X F, DF) H )) . (19) 
On a different but related matter, the Kolmogorov distance is defined by 

d Kol {X, Y) = sup \P(X <z)-P(Y<z)\. (20) 

Therefore we have 

d Kol (F, N) = sup |E (f' z (F) (1 - (-DL- X F, DF) )) | . 

By applying the Cauchy-Schwarz inequality, we get 



d Kol (F,AT) < [E ((f' z (F)) 2 )} 



E(Cl - (—DL~ 1 F,DF) n ) 2 



<i 



< yE ^(1 - {—DL~ 1 F, DF) n ) 2 J . (21) 
Recall that -F = and so in that case the equality 

stands. Thus, we can rewrite (|21() as 



d Kol {F,N) < cJE^l-g- 1 !!^!!^) 2 ) 



(22) 



with c = 1. As we mentioned in the introduction, the above inequality still holds true for 
other distances (Wasserstein, total variation or Fortet-Mourier) . The constant c is equal to 
1 in the case of the Kolmogorov and of the Wasserstein distance, c=2 for the total variation 
distance and c = 4 in the case of the Fortet-Mourier distance. 
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3 Berry-Esseen Bounds in the Central and Non-Central Limit 
Theorems 



As previously mentionned in the introduction, we will focus on the case where K = H q , 
H q being the Hermite polynomial of order q. In this case, we will be able to give a more 
appropriate representation of Sn in terms of multiple stochastic integrals. We will also 
assume Oj = for every i > 1 so the slowly varying function at oo is chosen to be 
identically equal to one. 



3.1 Representation of Sn as an Element of the g th -Chaos 

Note that X n can also be written as 

oo oo 
X n = (W n -i - W n -i-i) = ^ OLih (l[ n -i-l,n-i]) 



i=l 



^ ] a i^-[n—i—l,n—i] 



i=l 



\ 



fn 



h (fn) 



(23) 



As K = H q , we have 



N 



N 



S N = Y J [ H q ( X n)-^{H q {X n ))]=Y J [H q {h(fn))- V(H q (h (f n )))} 
n=l n=l 

We know that, if \\f\\ n = 1, we have H q (h(f)) = ^I q (f m ). Furthermore, we have 

/ oo oo \ 

ll/nll'H = (fnifn)i-i = ( ^ ] a i^-[n— i— l,n— i]i ^ ] °V ^-[n—r—l,n—r] / 



vi=l 



r=l 



H 



^ ^ OLiOL r ^l[ n _ j_ j], l[n— i — l,n— ■ 
i,r=l 

It is easily verified that if i > r ^ n — i < n — r — 1 or i < r n — r < n — i — 1, we 
have [n- i - l,n - i] n [n- r - l,n - r] = and thus <l[ n _i_i jn _i], l[n-r-i,n-r])^ = °- Jt 
follows that 

oo oo 

WfnWn = ^2 a i\\ 1 [n-i-l,n-i]\\ u = ^2 a i =1 - 
i=l i=l 
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Thanks to this result, Sn can be represented as 

TV A 



S N = E[2r,(Ii(/„))-E(2T 9 (^^ 

n=l 

TV TV 



n=l 



n=l 



3.2 Berry-Esseen Bounds for the Central Limit Theorem 

We will first focus on the case where q > (2/3 — 1) , i.e. the central limit theorem. Let 
Zn = -^r^ s N where a q ^ is given by 

q 



a := a 



1 



+00 / 00 

E (E a<Q! i+M 



\ 1 , +00 

= -y E ^(m). 

/ m=— 00 



(24) 



m=— 00 \i=l 

The following result gives the Berry-Esseen bounds for the central limit part of theorem [TJ 

Theorem 2 Under the condition q > (2/3— 1) , Z/v converges in law towards Z ~ A/"(0, 1). 
Moreover, there exists a constant Cp, depending uniquely on (3, such that, for any N > 1, 



sup \P(Z N <z)- P(Z < z)\ < Cp 



nI-p if 



2q-2> 



Proof: Theorem □ states that Z N — > M0,1). Because of §22) and (|2"21). we will 

TV— s>+oo 

evaluate the quantity 



((' 



E( (l-^pZjvll^)' 



We will start by computing ||DZjv||%. We have the following lemma. 
Lemma 1 The following result on \\DZn\\^ holds. 



1 9-1 
-\\DZ N \\ 2 H -1 = Y,MN)-1 

1 r=0 



where 



A r (N) 



qr\ ( q — 1 



a 



2 TV \ r 



2 TV 



k,l=l 



2g-2-2r I /f 



-1-r: 



-1-r 



(25) 
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Proof: We have 

DZ N = D 

and 



/ N \ N 

\ v n=l / v n=l 



2 



iV 



\\DZ N \\ 2 n = ^ E Vi (/r -1 ) Vi (/f 9_1 ) • (26) 

fc,/=i 

The multiplication formula between multiple stochastic integrals gives us that 

9-1 / 1 \ 2 



i — n \ / 



-l-r~ r®q-l-r\ i f r \r 

r=0 



(fk, fl)l 



H 



By replacing in (|26p . we obtain 

2 9- 1 / \ 2 ^ 

n*«* = -hY,4 q ~ ) E v*-* (/r ^/r x - r ) 

r=0 V 7 k,l=l 

and the conclusion follows easily. 

By using lemma[TJ we can now evaluate E ^1 — q" 1 WDZ^W^j ^ . We have 
E^l-g- 1 !!^^) 2 ) = EN^W-lj 

A-l 3-1 9-1 

= E E^r(A0+ E A r (N)A p (N)-2j2MN) + l 

\ r=0 r,p=0,r=£p r=0 

/q-2 q-2 

= e E^w + E^( Ar )^-i( Ar ) 

\r=0 r=0 
9-1 9-2 9-1 \ 

+ E E ^r(iV)A p (iV)-2EA(iV) + l . 
r=Op=0,r^p r=0 / 
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Recall that E(/ m / n ) = if m ^ n. Thus, E E%l, r ^ P A r {N)A p {N)J = 0. We can 

simplify our previous equality by writing 



V / \r=0 r=0 

9-1 9-1 \ 

_^ r(iV )-^ r (iV) + l 

r=0 r=0 / 

/9-2 9-1 



\r=0 r=0 
9-2 \ 

_sr Ar{N) - Aq _ l{N) + 1 \ 

r=0 / 

= E (j2A 2 (N) - (A q ^(N) - 1)) 

9-2 

= ^E(^(JV))-(ViW-l). (27) 

We need to evaluate the behaviour of those two terms as iV — > oo, but first, recall that the on 
are of the form «j = with /3 E (1/2, 1). We will use the notation a n ~ b n meaning that 
a n and b n have the same limit as n — > oo and a n ^ 6 n meaning that sup n>1 \a n \ / \ b n \ < oo. 
Below is a useful lemma we will use throughout the paper. 

Lemma 2 1. We have 

p(n) ~ cpn- 2/3+1 

with c p = J °° y~P{y + l) _/3 <iy = /3(2/3 - 1, 1 - 13). The constant cp is the same as the 
one in the definition of the Hermite random variable (see M6\) ). 



2. For any a£l, we have 



3. If a £ (— oo, — 1), we have 



n-l 



^k a S3 l + n a+1 . 



k=l 



fc=n 



Proof: Points 2. and 3. follow from [10], Lemma 4.3. We will only prove the first 
point of the lemma (as the other points have been proven in [10J). We know that p(n) = 
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X/i=i i ^ (i + \n\) 13 behaves as / °° x P(x + \n\) 13 dx and the following holds 

poo poo / \ — /3 poo 

J x- 13 {x + \n\)- p dx = j x-P \n\~P + lj dx = \n\~ 2f3+1 J y- p (y + l)~ 



cp 

Thus, 



p{n) = J2 (i + \n\)~ P ~ C/3 n- 2/3+1 . 



i=i 



We will start the evaluation of (I27h with the term (^4q_i(iV) — 1) and we can write 

! N 

k,l=l 

Note that we have 

oo 

(fk, fl)n = E a i a i+\l-k\ = P( l ~ k )- 
1=1 

Hence 

, a i a i+\l-k\ 



. N / oo 

fe,i=l \i=l 



1 



N / oo \ 9 

aia i+ |j_ fc | j - iVa 2 
fc,i=l \i=i / 

N / oo \ 1 +oo / oo 



fc,Z=l \i=l / m=-oo \i=l , 



Observe that 

V 



N / oo \1 N / oo \ 9 JV / oo 

E = E I E^+H-*! + E ( E ai£ 

fe/=l \i=l / fc<Z \i=l / k>l \i=l 



OO 



N N / oo \1 N N 

EE E q ^+mi +E E E a ^+i'-fci 

fe=l Z=fc \i=l / 1=1 fc=Z+i \i=l y 
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Let m = I — k. We obtain 

N / oo \ 1 N N-k / oo \ 1 N -1 / oo \ 9 

E E°^+I^l = EE \J2 ai0l i+\m\) + E E E a ^+M 
fe,Z=l \i=l / Hm=0 \i=l / 1=1 m=-N+l \i=l J 

N-l N-m / oo \ 9 -1 N+m / oo \ 9 

= EE E a*"*+M + E E E a ^ a i+\m\ 

rn=0 k=l \i=l J m =-(N-l) 1=1 \i=l ) 

N-l / oo \ 9 -1 / oo 

= E ( N ~ m M E a i a i+\rn\ I + E ^ + 771 ) ( E a i a i+\™ 
m=0 \i=l / m= _(AT_i) \j=l 

AT-1 / oo \ 9 jV-1 / oo \ 9 

= N E ( E a i a i+\™\ ) ~ 2 E m \ E Q * a *+M ) • 
m=-(N-l) \i=l / m=0 \i=l / 



By replacing in (|28|h we get 



, , N-l / oo \ 9 +oo / oo \ 9 

A ? _i(JV)-l = -^[N Yl E^+M _iV E E a * a *+M 

m=-(JV-l) \i=l / m=-oo \i=l ) 

9\ 



AT-1 / oo \ ' 

m=0 \i=l / 



-N / oo X 1 ? oo/oo \ 9 

^vi _Ar E (E^+h) E (E^+h) 

\ m=— oo \i=l / m=N \i=l / 
AT-1 / oo \ 9\ 

~ 2 E m E^^+m 



m=0 \i=l 

/ oo/oo 



9 AT-1 / oo \ 9\ 

2N E ( E a * a *+M ) - 2 E 771 E a * ai 



\ m=N \i=l / m=0 \i=l / / 

By noticing that the condition q > (2/3 — is equivalent to —q(2(3 — 1) < —1, we can 
apply Lemma [2] to get 

oo AT-1 

A q ^(N) - 1 *g ™~ q{2P ~ l) + E ™~ 9(2/3 ~ 1)+1 

m=N m=0 
^ N - q (2p-l)+l + N -l(l + ^-5(2^-1)4-2^ 

and finally 

A q -i(N) - 1 «S N~ l + AT9- 2 ^ +1 . (29) 
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Let us now treat the second term of ((57]), i.e. Er=o E ( j4 r( Ar )) • Here 

we can assume that 

r < q — 2 is fixed. We have 



(2 |2 / i \ 4 ^ 

%r*[ q ~ ) £ </*./«>S- 1 (/i./i) 
^ ' i,j,k,l=l 



r+1 

n 



t / f ®q-l-r~ f ®g-l-r 

Xhq-2-2r [J k ®h 



2q-1-%r ( /j 



)g— 1 — r~ ?®q — 1 — ?' 



AT 

i,j,k,l=l 

x ( /® 9 - 1 - r ®/,®«- 1 - r , fT-^ff 1 - 1 -"' 



(AT) 



where 



a,^>0 7,5>0 



A' 



Br,a,v,<y,s{N) — AT 2 ^ (/fc, Z/)?^ 1 (/i, (fk, fi)u (fk, fj)ft (fl, fi)\ (fl, fj)\ 

i,j,k,l=l 
N 

= n- 2 p(k-iy +1 p(i-j) r+1 p(k-ir P (k-jrp(i-iyp(i-j) s . 

i,j,k,l=l 

When a,z/,7 and 5 are fixed, we can decompose the sum Yl^j k 1=1 which appears in B r>ajl , a> g(N) 
just above, as follows: 



E + 

i=j=k=l 



\ 



E+E+E+E 

\ i=j=k i=j=l i=l=k j=k=l ■ 

Y l^i k^i j^i i^j J 



( 



+ 



\ 



E + E + E 



i=j,k=l i=k,j=l i=l,j=k 

\ k=£i j^ti j^ti j 



( 



+ 



E+E+E+E+E+E + E 

i = j>ky^i i=k,j^i i=l,k^=i j=k,k^i j=l,k^=i k=l,kj^i i,j>k,l 

\ tejtlJiti iitUk^l k^tjj^i k^l,l^i k^l,l^i k&,&i / iltj^k^l 



We will have to evaluate each of these fifteen sums separatly. Before that, we will give a 
useful lemma that we will be using regularly throughout the paper. 

Lemma 3 For any a £ M, we have 



n-l 



E i*-;r= Ei*-^^E^- 

i^j=l i,j=0 j=0 
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Proof: The following upperbounds prove this lemma 



v— m— 1 I ■ -IC 



Em=o( n - m ) ma 



< 



En— 1 o 
m=0 m 



+ 



Z^m=0 



£ 1 + 



2^m=0 " L 



2^=0 J 



< 2. 



Let's get back to our sums and begin by treating the first one. The first sum can rewritten 



as 



N ~ 2 E p(k-i) r+1 p^-j) r+1 p(k-i) a p(k-jyp(i-iy P (i-jY 

i=j=k=l 
N 



i=l 



For the second sum, we can write 

at- 2 52 p(k-iy +1 p(i-jy +1 p(k-iTp(k-jyp(i-iyp(i-j) 1 



i=j=k 



AT- 2 52 p(l-i) r+l+1+S = N- 2 52p(l-i) q . 



i=j=k 



At this point, we will use lemma [2] and then lemma [3] to write 

at- 2 52 p{k-iy +1 p{i-jy +1 P {k-iTp(k-jyp{i-iy P {i-j) & 



i=j=k 
N 



N-l 



^ AT-2 52 \l~ if- 2 ^ *3 AT" 1 52 l^ 2 ^ < N~\\ + AT- 2 ^+3+i) 
v£l=l 1=1 

For the third sum, we are in the exact same case, therefore we obtain the same bound 
iV -1 + N~ 2 P q+q . The fourth sum can be handled as follows 

n- 2 52 pik-iy+'p^-jy+'pik-iypik-jypii-iypii-j) 5 

i=k=l 

= n- 2 52 p(i-jy+ i+ »+ 5 ^N- 2 52\i-j\ {r+1+u+S){ - 2P+1) . 

i=k=l jj^i 
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Note that r + 1 + v + S > 1, so we get 

AT-2 £ _ r+l^, (i _ i) r+l p(A . _ _ _ _ ^ 



AT-1 

,3 AT-2 £ (i _ <g AT-i £ r 2/3+i ^ tv-1(i + at-2/3+2) 

sa A^ 1 + N~ 2f}+1 . 

For the fifth sum, we are in the exact same case and we obtain the same bound TV -1 + 
N~ 2/3+1 . For the sixth sum, we can proceed as follows 

7v- 2 p(k-i) r+l p(i-j) r+l P (k- i ) a p(k-jyp(i-iyp(i-j) 5 

i=j,k=l 

= N- 2 £ p(k - i) a+ ^ +<5 = N~ 2 P(k ~ i) 2q ~ 2r - 2 . 

k^i k^i 
Recalling that r < q — 2 <^ 2(q — r — 1) > 2, we obtain 

n- 2 p(k-iy +1 p^-j) r+1 p(k- l rp(k-jyp(i-zy P (i-j) s 

i=j,k=l 

N-l 

<g AT-2 £ \k - i|(2«-2r-2)(-2^+l) ^ ^ | fc _ { yW ^ N ~l ^ £-4/3+2 

kj^i k^i k=l 

We obtain the same bound, TV -1 + N~ 4/3+2 , for the seventh and eighth sums. For the ninth 
sum, we have to deal with the following quantity. 

at-2 p(k-iy+ 1 p(i- J y +1 p(k-zyp(k-jyp(i- l y P (i-j) s 

i=j,ky^i 

= n- 2 ^2 p{k - iy +1 P {k - iy~ r ~ l P {i - iy- r - 1 . 

k+i 



For k^i > observe that it can be decomposed into 



E+E+E+E+E- ( 3 °) 



k>l>i k>i>l l>i>k i>l>k i>k>l 
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For the first of the above sums, we can write 

n~ 2 p(k - iy +1 p{k - iy- r - l P {i - i) q - r - 1 

k>l>i 

S3 N- 2 £ (Jfe - - i)(«-»--l)(-20+l)(J - i)(«-r-l)(-2^+l) 

fc>i>t 

s3 iV- 2 £ (fc - Z)^ 2/3+1) G - (9 ~ r ~ 1 )(- 2 ^ +1 ) since k - i > k - I 

k>l>i 

= N ~ 2 E E( fc - i) q{ ~ 2f)+l) E( z - i) (9 - r - l)( - 2/3+l) 

k l<k i<l 

53 N ~ 2 E E^ - o 9( ~ 2/m) E^ - *)~ 2/m since g - r - 1 > l 

fc l<k i<l 
N fc-1 i-1 

fe=l Z=l «=1 
Note that ^f- 1 1 (fc-/)'?(-2/3+i) = Y^'l /"(-2/3+1) and that ^- 1 1 (/-i)"2/3+i = ^j-i j-20+1. 
We can also bound the terms ^f^ 1 l^P+i) (resp. Y,\=\ i~ 2l3+1 ) from above by Z^- 2 ^ 1 ) 
(resp. E^ 1 ^ 2/3+1 )- I* follow s that 

N- 2 p{k - l) T+1 p{k - i) q - r - 1 p{l - if- r - 1 

k>l>i 

N N-l N-l 

53 N ~ 2 E E ^ M/m) E r 2,3+1 

k=l 1=1 i=l 
N-l N-l 
S3 TV" 1 ^ /9(-2/3+D ^ r 2P+l 

1=1 i=l 

S3 Ar- X (l + iV^- 2 ' 3+1 ))(l + iV- 2 ^ 1 ) s3 N-\l + AT- 2 ^+-?+i)(i + AT-2/3+2) 

<3 AT" 1 + AT-2^+1 + N'Wq+q + ft-Wq- 2/3+2 _ 

Since -2/3 + 1 < 0, -2/3g + g < and that -2j3q - 2/3 + 2 < 0, it is easy to check that 

-2pq - 2/3 + 2 < -2$q + q< -2/3 + 1. 

Consequently, 

N~ 2 p( k ~ l) r+1 p(k - i) 9 ~ r ~V(* - if-''- 1 $3 N- 1 + N- 2I3+1 . 

k>l>i 

We obtain the exact same bound /V -1 + N~~ 2l3+1 for the other terms of the decomposition 
(|30p as well as for the tenth, eleventh, twelfth, thirteenth and fourteenth sums by applying 
the exact same method. 
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This leaves us with the last (fifteenth) sum. We can decompose % j k i as follows 



E + E +••• ( 31 ) 

k>l>i>j k>l>j>i 



For the first term, we have 



N ~ 2 E P(k-l) r+1 p(i-j) r+1 p(k-iTp(k-jy P (l- iV P {l-j) 5 

k>l>i>j 

< N- 2 ^ (fc - (» - j)(H-l)(-20+l) (/ - i)(5-r-l)(-2^+l) 

k>l>i>j 

= n- 2 E( fc - o 9( ~ 2/3+1) E( z - i) (? - r - i)( - 2/m) - 

k l<k i<l j<i 

N-1 N-1 N-1 

<g jy- 1 /<?(-2/3+l) ^(g-r-l)(-2/3+l) ^ (r+1) (-2/9+1) 

{=1 i=l j=l 

^ AT-^i + iY _2/39+,?+1 )(l + iV r (9- J, - 1 )(- 2 / 3 + 1 )+ 1 )(i + Ar( r + 1 )(-2/ 3 + 1 )+ 1 ) 

<] iV _1 (l + N- 2/3q+q+1 )(l + AT( r + 1 )(-2/3+l)+l + A r<?(-2/3+l)-(r+l)(-2/3+l)+l + i y< 7 (-2/3+l)+2 j 

< AT^l + AT-2^+ g +l) (1 + AT-2/3+2 + N -2?+2 + Arg (-2/3+l)+2 ) ^ f + ^ ? _ r _ j > j 
«3 iV- X (l + AT-2/3+2 + Ar g(-2^+l)+2) 

<g at-1 + AT-2/3+1 + Ar g(-2^+l)+l_ 

We find the same bound TV -1 + N~ 2/3+1 + N q (~ 2 P +1 > +1 for the other terms of the decom- 
position (|3T1) . 

Finally, by combining all these bounds, we find that 

max E (A 2 ) ^ N^ +1 + jV^+U+l, 

r=l,...,q~l V ' 

and we obtain 

which allow us to complete the proof. ■ 

Remark 1 1. When q = 2, 2 q-2 = \' so ^ e fi rs ^ ^ ne van i s hes. If Q > 2, 6oi/t Zmes 
exists and tt-^-tt — 5- i. 

When q < (2/3 — 1) , £/ie sequence Zn does not converge in law towards an A/*(0, 1). 
It converges (with another normalization) to a Hermite random variable. 
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3. The results in the above theorem are coherent with those found in Theorem 4-1- 
Indeed, in ilOij one works with Y n = B^ +l —B^ instead of X n , where B H is a fractional 
Brownian motion. Note that the covariance function p'(m) = E (YoY m ) ofY behaves 
as m 2H ~ 2 while, as it follows from Lemma{^ the covariance of X behaves as m _2/3+1 . 
Thus (3 corresponds to | — H. It can be seen that Theorem^ is in concordance with 
Theorem 4-1 in 1 10^ . 

3.3 Error Bounds in the Non-Central Limit Theorem 

We will now turn our attention to the case where q < (2/3 — 1) , where we will use the 
total variation distance instead of the Kolmogorov distance because that is the distance 
which appears in a result by Davydov and Martynova [6]. This result will be central to 
our proof of the bounds. Recall that the total variation distance between two real-valued 
random variables X and Y probability distributions is defined by 

d TY (C(X),C{Y)) = sup |P(Y P(X E A)\ (32) 

AeB(R) 

where B(M) denotes the class of Borel sets of R. We have the following result by Davydov 
and Martynova [6] on the total variation distance between elements of a fixed Wiener chaos. 



Theorem 3 Fix an integer q > 2 and let f £ T~L &g \ {0}. Then, for any sequence {/n} n >i C 
7i eq converging to f , their exists a constant c q j, depending only on q and f , such that 



d TV (I q (fn),W))<C q ,f\\fn-f\\lil q 



We will now use the scaling property of the Brownian motion to introduce a new sequence 
U n that has the same law as Sn- Recall that Sn is defined by 



iV 



S N = Y J H g [Y J a i (Wn-i-l - W n 



n=l \i=l 

Let U~n be defined by 

N / oo 



n=l \i=l 



Based on the scaling property of the Brownian motion, Un has the same law as Sjv for 
every fixed N. Recall that Theorem Q] states that 

h -l N Pg-l-l s _^ z (g) 
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where is a Hermite random variable of order q (it is actually the value at time 1 of the 
Hermite process of order q with self-similarity index 

defined in [5]). Let us first prove the following renormalization result. 
Lemma 4 Let 

h 2 „ = 

q\(-2f3q + q+l)( y -2f3 + q + 2 



2 2 4 



Then 

Proof: Indeed, since Sn = -t-T ? (/jv) we have 

2 1 ^ 

E = h^jLum-^ £ p(|„-m|)« 

n,m=l 



'(?!) 9,0 (90" 

v ^ y v ^ ' n,m=l;n>m 



iV 

n,m=l;n>m 



<^(g!) 



where for the last equivalence we notice that the diagonal term h q ^j^N 2 ^ q q 2 Np(0) q 

converges to zero since q < ^a—i • Therefore, by using the change of indices n — m = k we 
can write 

2 1 AT 

n,m=l 
1 * 

~ 2hq ijqY) NW9 ' q ' 2 ~ k)p{k)q 

1 - 

because, according to Lemma[2l p[k) behaves as cak~ 2l3+l when k goes to oo. Consequently, 

e (k-lN^s s Y ~ a-j > 1 f f i - A) f AV 2e,+ ' 
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and this converges to 1 as N — > oo because Ylk=i (l ~~ 77 ) (77) 2 ^ 9+<? converges to 

1 



f\l-x)x- 2 ^ +q da 
Jo 



(-2/3q + q + l)(-2Pq + q + 2y 



Let Zn be defined here by 

Z N = NP q ~2- l JJ N = H q ( ^aim (Wn-i-i - Wn^ 



N 



n=l 



We also know that h\Z 



1 ,./_. \ — Z( q ' in law (because Cat has the same law as Sjv), with 

given by (|14p . Let us give a proper representation of Zjv as an element of the g th -chaos. 
We have 



v 



Z N = AT^-f-l J2 H l[^2 a ^ ( W - 



W 



n=l 
N 



.1=1 



n — i 
N 



n=l V V i=l 
n=l y ' V V i=l 
\ n=l \i=l 



Qjlrn-i-l 



ra — i— 1 n — il 



1 

(7' 



V 



71=1 



V 



with <? n = ]Ci=i Qiilr n-i-i n-i j and gjy = N@ q 1 Y2n=l 9^ q e % 0,? - We will see that h q ^Zjy 
converges towards Z in L 2 (£l), or equivalently that |^[^ l g^5'A r | converges in L 2 (R® 9 ) = 
H® q to the kernel g of the Hermite random variable (|15p by computing the following L 2 



norm. 



E 



E 



-y h q }9N ~ 9 



2 



We will now study \\gjsf — g|| w ® 9 and establish the rate of convergence of this quantity. 
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Proposition 3 We have 



Kiql9N-9 



In particular the sequence h\^g^ converges in L 2 (R® 9 ) as N — )■ oo to the kernel of the 
Hermite process g \15}) . 



Proof: We have 



N 



I'H 



\gN\\ 2 H m = N 2l3q ~ 2 (sn,g k 

n,k=l 

N I oo oo 

n,k=l \ JK i=l j=l 



k-j-i fe-ji (u)du 

N ' N I 



N / oo 

n,fc=l \i=l 

TV / oo \< 

N 2fi q - q -2J2 lj2i- p (i+\n-k\)- p \ 

n,k=l \i=l / 



(34) 



In addition, based on the definition of the Hermite process, we have 

i ii i- i 

Let us now compute the scalar product {gNig)^" where g is given by (fT5l) . It holds that 

TV 
n=l 

n=l J \i>! J* [ 



' n—i—1 n—i 



(y)dy du 



N N „± / . 
n=lk=l J ^T \i>l JK 



y)^! ^-^-! n-i](y)dy du. 
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We will now perform the change of variables u' = (it — ^j^-)N and y 1 = (y — 11 4 1 )N 
(renaming the variables by u and y), obtaining 



N N fX 

d( g ,P)N^N~^J2E (E 

n=l fc=l Jr 



i>l 



1 fu — y + k — n + i 



N 



-P 



dy du 



N N-l 



n=l k=l \ i>l 



k — n + i 
N 



-p 



where we used the fact that when N — >■ oo, the quantity is negligible. Hence, by 
eliminating the diagonal term as above, 



fc,n=l;fc>n \i>l 



n) 



+d(q,P)N 2 ^- q - 2 E «i(i + fc-n)-^ 

k,n=l;k<n \i>n—k 

and by using the change of indices k — n = I in the first summand above and n — k = I in 
the second summand we observe that 



N 



(9N,g) 



1=1 \i>l 
+d(q, P)N 2 ^~ 2 f> - I) I - /)-' ; 



(35) 



i>l 



By summarizing the above estimates ()34p and (|35p . we establish that 



KhsN-9 



jytpq-q- 



2 / C 2_l 7T _L^ (Ar _ A , ) | j2i-P(i + kp : 



o>P (q\) 2 N 



i>l 



1 1 



fc=i 



i>l 



fe=i \i>fc / 
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To obtain the conclusion, it suffices to check that the sequence 

q 



1 1 N 



i>l 



1 1 N 



<-[ 

-P ^ 



- 2d ^^KhN^ {N - k) \^ r " {l + k) 

q ' k=l \i>l 
y ' fe=l \i>k ) 



-2/3q+<j+l 



is uniformly bounded by a constant with respect to N. Since d(g, P)h q ^ = ^ /i g |, Yli>i * ^(^+ 
/c) _/3 ~ C/3 A;- 2 ^+9 and 

i>fc i>l 

(by the change of notation i — k = j), the sequence ajv can be written as 

-2/39+9+ 1 I 



q 



1 / i * 

_(_2/3g + q + l)(-2/3g + 9 + 2)- - k)k~ 2 ^ + iV 

? ' V fe=i 

It is easy to check that 

N~ 2 P q+q+1 = N~ 2 P q+q+1 (—2f3q + q + l)(—2fiq + q + 2) / (1 — x)x~ 

Jo 

1 /"^ 

= (-2f3q + q + l)(-2f3q + q + 2)- J (N — y)y~ 2 ^ q+q dy 



(by the change of variables xN = y). Thus 



q \a N „ dy{{N-y)y-^ q+q -(N-k)k- 2 P q+q ) 

N r k i N r k 

< E / r/ " ]?r 2/3,?+9 - k- 2 ^\ + ^ E / "~ 2/3 "' + " +J '•■- 2 J " + " +l 



y -z Pg+9+ i _ fe - 



JV , AT 



< W(fc - l)- 2 ^+9 _ fc- 2 ^) + - E (k- 2Pq+q+1 — (k — l)~ 2 ^+ q+1 



fc=l k=l 

and elementary computations show that the terms on the last line above are of order of 

N -2f3q+q+l^ g 

As a consequence of Proposition [3] and of Theorem El we obtain 
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Theorem 4 Let q < 



2/3-1 



an 



d let Sn be given by ([?]). 



d TV (^-JiV^-f^Sjv,^) < Coiq,^ 2 ^- 1 
where is given by ftl4\ ), hq,p is given by \33\) and Co(q,(3) is a positive constant. 

4 Application: Hsu-Robbins and Spitzer theorems for mov- 
ing averages 

In this section, we will give an application of the bounds obtained in Theorems [2] and [U 
The purpose of the Spitzer theorem for moving averages is to find the asymptotic behavior 
as e — > of the sequences 



N>1 



when q > 



2/3-1 



and 



N>1 



when q < • The cases of the increments of the fractional Brownian motion were treated 
in [16] . The same arguments can be applied here. Let us briefly describe the method used 
to find the limit of f(e) as e — > 0. Let q > 2 p-i so ^ ne nm it of o~~ 1 -^Sn is a standard 
normal random variable. We have 



Me) 



eVN 



N>1 



D / -1 1 IC I E ^ N 

P I a x — |5jv| > 



P\\Z\> 



eVN 



a 



where Z denotes a standard normal random variable. The first summand above was esti- 
mated in [16], Lemma 1 while the second summand converges to zero by using the bound 
in Theorem [2] and the proof of the Proposition 1 in [16] . When q < 2 p-i ; similarly 



JV>1 

= E > ( Z(Q) > d-,leN-^ 



N>1 



N>1 
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with a Hermite random variable of order q. The first summand was also estimated in 
[16j . Lemma 1 while the second summand can be handled as in Proposition 2 in [16] and 
the result in Theorem HJ Hence, we obtain 

Proposition 4 When q > 2 p~\ > 

lim - 1 . - /i(g) = 2 
e^o-log(e)' u 

and when q < 2 b-x then 

}^^T) h{£) = YTf^iTq 

It is also possible to give Hsu-Robbins type results, meaning to find the asymptotic behavior 
as e — > of 

g 1 (e) = Y / p (\SN\>eN) 

N>1 

when q > 2 8-i ana ^ 

g 2 (s) = P (\S*\ > eN-^+«+ 2 ) 

N>1 

when q < 2 r~i ■ This also follows from Section 4 in |16j and Theorems [2] and [H 
Proposition 5 When q > 2 /3-i > 



Yun(a~le) 2 gi (e) = l = B(Z 2 ) 

and when q < 2 ^ 1 _ 1 then 

lim(h-}£) T +i Z ^g 2 {e) = E Z iq) 
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